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Abstract. We give tight upper and lower bounds of the cardinality of the index sets of certain hyperbolic crosses which 
reflect mixed Sobolev-Korobov-type smoothness and mixed Sobolev-analytic-type smoothness in the infinite-dimensional case where 
specific summability properties of the smoothness indices are fulfilled. These estimates are then applied to the linear approximation 
of functions from the associated spaces in terms of the e-dimension of their unit balls. Here, the approximation is based on linear 
information. Such function spaces appear for example for the solution of parametric and stochastic PDEs. The obtained upper and 
lower bounds of the approximation error as well as of the associated e-complexities are completely independent of any parametric 
or stochastic dimension. Moreover, the rates are independent of the parameters which define the smoothness properties of the 
infinite-variate parametric or stochastic part of the solution. These parameters are only contained in the order constants. This way, 
linear approximation theory becomes possible in the infinite-dimensional case and corresponding infinite-dimensional problems get 
tractable. 
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1. Introduction. The efficient approximation of a function of infinitely many variables is an important 
issue in a lot of applications in physics, finance, engineering and statistics. It arises in uncertainty quantification, 
computational finance and computational physics and is encountered for example in the numerical treatment 
of path integrals, stochastic processes, random fields and stochastic or parametric PDEs. While the problem 
of quadrature of functions in weighted Hilbert spaces with infinitely many variables has recently found a lot of 
interest in the information based complexity community, see e.g. O [13 [13 [IZl [5313313111331HH Sll 13313111331 
I58j . there is much less literature on approximation. So far, the approximation of functions in weighted Hilbert 
spaces with infinitely many variables has been studied for a properly weighted L 2 -error norn|3 in |60j . In any case, 
a reproducing kernel Hilbert space Hk with kernel K = i® employed with |u|-dimensional kernels 

where u varies over all finite subsets of N. It involves a sequence of weights 7 = ( 7 „) that moderate the influence 
of terms which depend on the variables associated with the finite-dimensional index sets u C. {1,2,...} = N. 
Weighted spaces had first been suggested for the finite-dimensional case in 133]i see also [S3 [53]. For further 
details, see [18j and the references cited therein. The approximation of functions with anisotropically weighted 
Gaussian kernels has been studied in m- 

Moreover, there is work on sparse grid integration and approximation, see [5] for a survey and bibliography. 
It recently has found applications in uncertainty quantification for stochastic and parametric PDEs, especially 

for non-intrusive methods, compare [3[i[IIl[Il[I3[Il[33[3i[371[31[33[3Sl- There, for the stochastic or 

parametric part of the problem, an anisotropic sparse grid approximation or quadrature is constructed either 
a priori from knowledge of the covariance decay of the stochastic data or a posteriori by means of dimension- 
adaptive refinement. This way, the infinite-dimensional case gets truncated dynamically to finite dimensions 
while the higher dimensions are trivially resolved by the constant one. Here, in contrast to the above-mentioned 
approach using a weighted reproducing kernel Hilbert space, one usually relies on spaces with smoothness of 
increasing order, either for the mixed Sobolev smoothness situation or for the analytic setting. Thus, as already 
noticed in [49] . one may have two options for obtaining tractability: either by using decaying weights or by 


^ There is also 15911611 l62l . where however a norm in a special Hilbert space was employed such that the approximation problem 
indeed got easier than the integration problem. 
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using increasing smoothness. 

Sparse grids and hyperbolic crosses promise to break the curse of dimensionality which appears for conven¬ 
tional approximation methods, at least to some extent. However, the approximation rates and cost complexities 
of conventional sparse grids for isotropic mixed Sobolev regularity still involve logarithmic terms which grow 
exponentially with the dimension. In |231131) it could be shown that the rate of the approximation error and the 
cost complexity get completely independent of the dimension for the case of anisotropic mixed Sobolev regularity 
with sufficiently fast rising smoothness indices. This also follows from results on approximation for anisotropic 
mixed smoothness, see, e.g., [HJ for details. But the constants in the bounds for the approximation error 
and the cost rate could not be estimated sharply and still depend on the dimension d. Therefore, this result 
can not straightforwardly be extended to the infinite-dimensional case, i.e. to the limit of d going to oo. 

This will be achieved in the present paper. To this end, we rely on the infinite-variate space 'H which is the 
tensor product H := H“((G™) ® of the Sobolev space iJ“((G™) and the infinite-variate space A"'’(D°°) 

of mixed smoothness with varying Korobov-type smoothness indices r = ri,r 2 ,..., or we rely on the tensor 
product H := 0 of with the infinite-variate space of mixed smooth¬ 

ness with varying analytic-type smoothness indices r = ri,7’2,... (and p and q entering algebraic prefactors). 
The approximation error is measured in the tensor product Hilbert space G := 0 L 2 (D°°, p) with 

/3 > 0, which is isomorphic to the Bochner space L 2 {^°°, Here, G denotes either the unit circle 

(one-dimensional torus) T in the periodic case or the interval I := [—1,1] in the nonperiodic case. Furthermore, 
D is either T, I or R, depending on the respective situation under consideration. Altogether, G™ denotes the 
TO-fold (tensor-product) domain where the m-dimensional physical coordinates live, whereas ID)°“ denotes the 
infinite-dimensional (tensor-product) domain where the infinite-dimensional stochastic or parametric coordi¬ 
nates live. Moreover, L2G3>°°) := L 2 {Si°°, p) is the space of all infinite-variate functions / on such that 
/doo l/(y)Pd^(y) < oo with the infinite tensor product probability measure dp, which is based on properly 
chosen univariate probability measures. 

Here, the spaces H°‘(G™‘) 0 AT'’(11)°°) generalize the usual d-variate Korobov spaces of mixed 

smoothness with different smoothness indices ri,... ,rd to the infinite-variate case and additionally contain 
in a tensor product way also the Sobolev space iJ“(G™). Moreover, the (m -I- d)-variate Sobolev-Korobov- 
type spaces TLd ■= id“(G'") 0 Ar''(ID)‘^) of mixed smoothness with different weights for arbitrary but finite d 
are naturally contained. Similarly, the spaces iJ“(G™) 0 A''’^’’‘^(D°°) generalize the d-variate spaces of mixed 
analytic smoothness with smoothness indices p, q and ri,..., (for a precise definition, see Subsection 12.21) to 
the infinite-variate case and additionally contain in a tensor product way the Sobolev space id“(G'"). Moreover, 
the (m -I- d)-variate Sobolev-analytic-type spaces T-Ld '■= id“(G™) 0 A''’^’’‘^(D^) of mixed Sobolev and analytic 
smoothnesses with different weights for arbitrary d are naturally contained. Thus, the problem of approximating 
functions from Td in the G = id^(G'") 0 A 2 (ro°°) —norm directly governs the problem of approximating functions 
from T-Ld in the Gd '■= H^(G^) iS> ^2(0'^) —norm in both cases, where d may be large but finite. 

Now, let us fix some notation which is needed to describe the cost complexity of an approximation. In 
general, if A is a Hilbert space and W a subset of X, the Kolmogorov n-width d„(lF, A) [35] is given by 

dn(W,X):= inf sup iiif \\f - g\\x, (1-1) 

M„ f^w 9^^-n 

where the outer infimum is taken over all linear manifolds Mn in A of dimension at most nH Furthermore, 
the so-called e-dimension rig = rig (IF, A) is usually employed to quantify the computational complexity. It is 
defined as 

rieiyV.X) := inf < n : 3 Mn : dimMji < n, sup inf ||/ — g\\x < e 
( /GW 96^" 

where Mn is a linear manifold in A of dimension < n. This quantity is just the inverse of d„(IF, A). Indeed, 
rig (IF, A) is the minimal number such that the approximation of IF by a suitably chosen Ug-dimensional 

^ A different worst-case setting is represented by the linear n-width Xn{W,X) ESj. This corresponds to a characterization of 
the best linear approximation error, see, e.g., m for definitions. Since X is here a Hilbert space, both concepts coincide, i.e., we 
ha.vedn{W,X) = Xr,{W,X). 
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subspace Mn in X yields the approximation error to be less or equal to e. Moreover, ne{W,X) is the smallest 
number of linear functionals that is needed by an algorithm to give for all f € W an approximation with an error 
of at most e. From the computational point of view it is more convenient to study ne(W,X) than dn(W,X) 
since it is directly related to the computational cost. 

The approximation of functions with anisotropic mixed smoothness goes back to papers by various authors 
from the former Soviet Union, initiated in [T] . We refer the reader to [221155] for a survey and bibliography. 
In particular, in the rate of the cardinality of anisotropic hyperbolic crosses was computed and used 
in the estimation of d„(C/'’(T‘^),L 2 (T'^)), where [/'’(T'^) is the unit ball of the space of functions of bounded 
anisotropic mixed derivatives r with respect to the L 2 Cir‘^)-norm. Moreover, the e-dimensions of classes of 
mixed smoothness were investigated in [191 [Ml iMl IM] ■ Recently, n-widths and e-dimensions in the classical 
isotropic Sobolev space of d-variate periodic functions and of Sobolev classes with mixed and other 

anisotropic smoothness have been studied for high-dimensional settings El US]. There, although the dimension 
n of the approximating subspace is the main parameter of the convergence rate, where n is going to infinity, 
the parameter d may seriously affect this rate when d is large. 

Now, let U and Ud be the unit ball in % and Hd, respectively. In the present paper, we give upper and lower 
bounds for neiU^Q) and ne{Ud,Qd) for both, the Sobolev-Korobov and the Sobolev-analytic mixed smoothness 
spaces. To this end, we first derive tight estimates of the cardinalities of hyperbolic cross index sets which are 
associated to the chosen accuracy e. Since the corresponding approximations in inhnite tensor product Hilbert 
spaces then possess the accuracy e, this indeed gives bounds on rieiU^Q) and ne(Ud,Gd)- Here, depending on 
the underlying domain, we focus on approximations by trigonometric polynomials (periodic case) and Legendre 
and Hermite polynomials (nonperiodic case, bounded and non-bounded domain) with indices from hyperbolic 
crosses that correspond to frequencies and powers in the infinite-dimensional case. Altogether, we are able to 
show estimates that are completely independent on any dimension d in both, rates and order constants, provided 
that a moderate summability condition on the sequence of smoothness indices r holds. 

In the following, as example, let us mention one of our main results on the cardinality of hyperbolic crosses 
in the infinite-dimensional case and on the related e-dimension. To this end, let m, a, j3, r,p, q be given by 

mSN; a>/3>0; r = (rj)^i £ K+, 0 < ri < r 2 < • • • < • • • ; p> 0, q > 0. (1.2) 

(with the additional restriction (a — f3)/m < ri for the Sobolev-Korobov smoothness case). Then, if moderate 
summability conditions on the sequence of smoothness indices r hold, we have for every d G N and every 
e G (0, 1] 

< n,(lld,gd) < n,iU,g) < (1.3) 

where C depends on m, a, /3, r, p, q but not on d. Thus, the upper and lower bounds on the e-dimension Ue {Ud, Qd) 
are completely free of the dimension for any value of d. These estimates are derived from the relations 

|G(e-i)|-l < n,{U,g) < \G{e-% 

and 

|^j.l/(a-/3)jm ^ \G{T)\ < (1.4) 

where G{T) is the relevant hyperbolic cross induced by T = £~^ and G is as in (II.3L Throughout this paper, 
|G| denotes the cardinality of a finite set G. 

Note here the following properties of (IE3D: 

(i) The upper and lower bounds of ne{Ud,gd) and ne{U,g) are tight and independent of d. 

(ii) The term depends on £, on the dimension m and on the smoothnesses indices a and P of 

the Sobolev component parts iL“((G™) and iL^((G'") of the spaces T-L and G only. 

(iii) The infinite series of smoothness indices r in the Korobov or analytic component parts is contained in 
C only and does not show up in the rates. 

(iv) The necessary summability conditions on m,a, P,r,p,q are natural and quite moderate (see e.g. the 
assumptions of Theorem 13.61) . 
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Altogether, the right-hand side of (11.31) is (up to the constant) just the same as the rate which we would obtain 
from an approximation problem in the energy norm of functions from the Sobolev space 

alone, i.e. ne(?7“(G™),x where {/“(G"*) is the unit ball in i(/“(G™). Therefore, the 

e-dimension and thus the complexity of our infinite-dimensional approximation problem is (up to the constant) 
just that of the m-dimensional approximation problem without the infinite-variate component. 

From m) we can see that the d-dimensional problem ng{Ud,Gd) is strongly polynomially tractable. This 
property crucially depends on the chosen norm as well on certain restrictions on the mixed smoothness, see 
for instance the prerequisites of Theorem 12.61 and of Theorem 14.11 in the case of mixed Sobolev-Korobov-type 
smoothness. If a different type of norm definition is employed, completely different results are obtained. For an 
example, see [49], where it is shown that increasing the smoothness (no matter how fast) does not help there. 
Moreover, the effect of different norm definitions on the approximation numbers of Sobolev embeddings with 
particular emphasis on the dependence on the dimension is studied for the periodic case in [Ml SOI mi- 

For an application of our approximation error estimate, let us now assume that an infinite-variate function 
u is living in G which is isomorphic to the Bochner space L 2 (D'^, id^(G'")). Let us furthermore assume that u 
possesses some higher regularity, i.e., to be precise, assume that u €% with either 'H = id“(G"*) 0 iF'’(lD)°°) or 
H = iL“(G™) 0 A'’’^’’'J(ID)°°). Let n = |G(r)| and L„ be the projection onto the subspace of suitable polynomials 
with frequencies or/and powers in G{T). Then, with the above notation and assumptions for e-dimensions, we 
have 


\\u-Kiu)\\G < 

where C is as in (O. Indeed, such functions u are, for certain ct(x, y) and /(x, y), the solution of the parametric 
or stochastic elliptic PDF 


- divx(CT(x,y)Vxu(x,y)) =/(x,y) x e G™ y G D~, (1.5) 

with homogeneous boundary conditions m(x, y) = 0, x G G™, y G 1D>°°. Here, we have to find a real-valued 
function u : G™ x ]D>°° —>■ R such that (11.51) holds /r-almost everywhere. Thus, our results also shed light on 
the er-dimension and the complexity of properly defined linear approximation schemes for infinite-dimensional 
stochastic/parametric PDFs in the case of linear information. 

The remainder of this paper is organized as follows: In Section |21 we establish tight upper and lower bounds 
for the cardinality of hyperbolic crosses with varying smoothness weights in the infinite-dimensional setting. In 
Section 121 we study hyperbolic cross approximations and their e-dimensions in infinite tensor product Hilbert 
spaces. In Section [d] we consider hyperbolic cross approximations of infinite-variate functions in particular for 
periodic functions from periodic Sobolev-Korobov-type mixed spaces and for nonperiodic functions from the 
Sobolev-analytic-type mixed smoothness spaces. In Section [S] we discuss the application of our results to a 
model problem from parametric/stochastic elliptic PDFs. Finally, we give some concluding remarks in Section 

m 


2. The cardinality of hyperbolic crosses in the infinite-dimensional case. In this section, we 
establish upper and lower bounds for the cardinality of various index sets of hyperbolic crosses in the infinite¬ 
dimensional case. First, we consider index sets which correspond to the mixed Sobolev-Korobov-type setting 
with varying polynomial smoothness, then we consider cases with mixed Sobolev-analytic smoothness where 
also exponential smoothness terms appear. 

We will use the following notation: is the set of all sequences y = with yj G R and is the 

set of all sequences s = (sj)^i with Sj G Z. Furthermore, := {s G Z°° : Sj >0, j = 1, 2,...}, yj is the jth 
coordinate of y G R°°. Moreover, Z^ is a subset of Z°° of all s such that supp(s) is finite, where supp(s) is the 
support of s, that is the set of all j G N such that Sj ^ 0. Finally, Z“^ := ZJ° n Z“. 

2.1. Index sets for mixed Sobolev-Korobov-type smoothness. Let m G Z+, a > 0 be given and let 
= (^j)^i G R+ be given with 


0 < r = ri • • • = rt+i; rt+i < rt+3 < • • • . 


4 


For each (k, s) G Z™ x ZJ“ with k G Z™ and s G ZJ“, we define the scalar A(k, s) by 

t+1 OO 

A(k,s):= miix {1 + \kj\y Y[{1 + \sj\Y (1 + |sj . (2.1) 

j=l j=t-\-2 

Here, the associated functions will possess isotropic smoothness of index a for the coordinates kj, they will 
possess mixed smoothness of index r for the first f + 1 coordinates Sj of s and they will possess monotonously 
rising mixed smoothness indices rj for the following coordinates Sj. 

Now, for T > 0, consider the hyperbolic crosses in the infinite-dimensional setting Z™ x Zjp^ with indices 

a, r 

G{T) := {(k,s) e Z!(* X Z“ : A(k,s) < T}. (2.2) 

The cardinality of G{e~^) will later describe the necessary dimension of the approximation spaces of the asso¬ 
ciated linear approximation with accuracy e. 

We want to derive estimates for the cardinality of G{T). To this end, we will make use of the following 
lemmata. 

Lemma 2.1. Let fj,,v gN with ^>v, and let ip be a convex function on the interval (0,oo). Then, we have 

M ^ poo 

'S^Lp{k) < / ip{x)dx, and 'S^if{k) < / ip{x)Ax, (2-3) 

k=y Jv-l/2 Jv-lj2 


Proof Observe that, for a convex function g on [0,1], there holds true the inequality 

ff(l/2) < ^ / [ 5 (x)-b g(l - a;)] da; = [ g{x)dx. 

^ Jo Jo 

Applying this inequality to the functions gk{x) '■= ip{x + k — 1/2), k gN, we obtain 

fl rk+l/2 


/o 

Hence, we have for any 11,12 G N with g.> v, 

V V pk+ 1/2 


T{k) = 5fc(l/2) < / gk{x)dx = / (p{x)dx. 

Jo Jk- 1/2 


V(/7(fc) < V / ip{x)dx = / ip{x)dx 

k=u k=v''^~^G J12-1/2 

which proves the first and, with /r —>■ 00 , the second inequality of the lemma. 
Lemma 2.2. Let rj > 1. Then, we have 

1 


k=2 


< 


g-l \2 


Proof. Since the function a; is non-negative and convex on (0, 00 ), we obtain 


00 

^ i 


x ^ dx = —— 

3/2 ^ ~ 1 \ 2 




by applying Lemma l2. II for 12 = 2. 

Lemma 2.3. Let 77 G K \ (0,1) and g, G N. Then, we have 


Y.k’' < 


(2.4) 

(2.5) 

( 2 . 6 ) 
□ 

(2.7) 


^ ('3'!>7+1 r,+l 
77+1 V2/ ^ ’ 

g > -1, 


log(2/i-b 1), 

g = -1, 

(2.8) 

1 

hl-l 

g < —1. 



5 







Proof. The function is non-negative and convex in the interval (0,oo) for 77 G ]R\ (0,1). Thus, there holds 
by Lemma 12.11 


Hence, 


rii+1/2 

Vfc’' < / x'^dx = i 


1 ry.V + 1 

J7+1 


M-I-1/2 

1/2 


logx 


11 - 1 - 1/2 

1/2 


V + - 1 , 

77 = - 1 . 


< 




f;^(71+l/2)’'+l, 77>-l, 

log(M +1/2)+log2, 77 = -l, 

77 < - 1 , 


]_2l';l-i 

FtFT 


(2.9) 


( 2 . 10 ) 


which implies (12.81) . 

First of all, for T > 1, tti £ N, we consider the hyperbolic cross in the finite, 77 i-dimensional case 

r(T) := |l £ N™ : < tI. 

We have the following bound for the cardinality |r(T)|: 

Lemma 2.4. For T > 1, it holds 


|r(T)| < 


{m— 1 )! 


r(logT -I- mlog2) 


m—1 


( 2 . 11 ) 


Proof. Observe that |r(r)| = |r*(T)|, where 

r*(T) := -.Ylil + lj) <T\. 


i=i 


( 2 . 12 ) 


Thus, we need to derive an estimate for |r*(r)|. From [51 Lemma 2.3, Corollary 3.3], it follow^ that for every 
T > 1, 


|F*(T)| < 


2"" T(logr-tmlog2)™ 
(tti — 1)! logT-I-TTi log 2 + TO — 1 


(2.13) 


Since m > 1 we immediately obtain the desired estimate. 
Now, for given to, < £ N and a, r > 0, put 


B{a, r, TO, t) := 


I 2 / “I" rm/a-l \2j J ’ 

2t+l 

TO—, 

m 2-^(a/r — m)~^ 2 “/’’“™, 


r > a/m, 
r = a/m, 
r < a/m. 


□ 


(2.14) 


^There, the set {1 G : 05 ^ 1(1 h) — analyzed. Since our r*(T) is a subset, (I2.13II clearly holds. A direct bound for 

(I2.12I I might be possible without the multiplier 2^, but only for T = T{m) large enough. See [9] for details. 
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Furthermore, define 


r > a/m, 

A{a,r,m,t,T) := < log(2T^/“ + logT + (t + 1) log 2]*, r = alm, 

logT + (t + 1) log2]‘, r < afm. 

Next, for T > 1, we consider the hyperbolic crosses in the finite, {m + t + l)-dimensional case 

^ m+t+1 N 

H{T):= jneN’"+*+i: max n“ 

f 1<J<™ j=m+l ^ 

We have the following bound for the cardinality \H{T)\: 


(2.15) 


(2.16) 


Lemma 2.5. For T > 1, it holds 


\H{T)\ < B{a,r,m,t) A(a,r,m,t,T) 


(2.17) 


Proof. Let us introduce the following notation for convenience: For n G pjm+t+i^ we write n = (n',n”) with 
n' = (m, ...,nm) and n = (rim+i, ■■■,nm+t+i)- We then represent as 

j^m+t+l _ ^ pjt +1 

We first consider the case r < a/m. Note that, for every n € H{T)^ we have that rij < j = 1, ...,m. 

For a n' G N™ put 


7n' = I T( max rij) “ 

Hence, by symmetry of the variables, we have for every T > 1, 

mT)\= E E E 


l/r 


E 


1. 


n': n": UT=i/+l 


n'-. < (Tn;;“)'^’' 

.rim, T — -J ^ ^ ' 


(2.18) 




The inner sum in the last expression is |r(r„/)| from (12.121) with m = t+l. The application of Lemma then 
gives for every T > 1 


\HiT)\ < m E 


|r(rn')l 


n': nm<T^^°- 
njKrim, —1 


< m E '^n' (log'^n' + {t+ l)log2)‘ 


n': nm<T^^°- 
njKrim, —1 


<m E ^ (rn-“)'/’'(log((Tn-“)i/n + (i + l)log2)’ 


n': n^<T^I'^ 
njKrim, —1 


(2.19) 


< 


«^^Ti/'-(iog(ri/’-) + (t + i)iog2)' E E 


..-a/r 


^<J'l/a nj<nr, 


< 


0^+1 / \ r 

m —Ti/'-(log(ri/’-) + (t + l)log2) E 
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Now, by applying Lemma 12.31 with k = rim-: rj = m — 1 — a/r and /i = to the sum in the last line of 

(12. 191) . we derive 




riog( 2 LTi/“J + 1 ), r = a/m, 

[ (a/r — m)“^ 2“/’’“™, r < a/m, 


( 2 . 20 ) 


which, together with (I2.19P and the definitions (12.141) and (12.151) . proves (12.171) in the case r < a/m. 
Let us now consider the case r > a/m. For an £ we put 


m+t+1 


T^„ = Ti/“ 


— r IO 


j=m+l 


Note that, for every n £ H{T), we have that rij < j = m+ 1, ...,m + t + 1. By symmetry of the variables, 

we have for every T > 1, 


\HiT)\ = E 


E 


n": maxi< 3 <„ 


< m 


E 


E 1 

n^: 

j=m+l,...,m+t+l nj<nm, 


" ^ /-r. 

n : 


^ ^ E E 

n": nm<T^„ 


From (12.101) and the inequality T^n > 1 it follows that 

-I -j 1 X \ 7TL~\~t~\~ 1 

E < -(7’„"+l/2)™< -iT^"+T^"l2r < - 2 n 

C'T' .. \ / 'i—ryj-l 


n 


— rmja 


r<T 


Hence, 


\HiT)\ < r-/“ E 

' ' /t- 


m+t+1 

n 

nj<T'^/'^, J—m+l,...,m+i+l J— 
m m+i+1 




j=rn+l 


—rmja 


rpmj a n E 

j=m+l nj<Ti/’' 


— rmja 


( 2 . 21 ) 


( 2 . 22 ) 


< 


m m+i+1 


j.m/a JJ- 1 + E 

j=m+l \ 


—rmja 


< '2 


m m+i+1 / 

jim/a JJ" j 2 ^ 

j=m+l \ 


1 


rm/a — 1 \2 


— (rm/a —1)'' 


(2.23) 


jim/a I ^ _|_ 


1 


rm/a — 1 y 2 


— (rm/o—1)\ ^ 
















With the definitions (12.141) and (12.151) . this proves (12.171) in the case r > ajm. □ 

We will frequently use the following well-known bound for infinite products: Let be a summable 

sequence of positive numbers, that is < oo- Then, we have 

oo / oo \ 

^(l+Pfc) < expl^pfcj. (2.24) 

k=l \k=l / 


Now we are in the position to state the main result of this section, i.e. we will give explicit bounds on the 
cardinality of the infinite-dimensional hyperbolic cross G{T) defined in (12.21) . To this end, let the triple to, a, r 
be given by 

TO e N; a > 0; r = (rj)“ j, 0 < r = ri • • • = rt+i, rt +2 < rt +3 < ■ ■ ■ ■ (2.25) 

We put 


A := maxjm/a, 1/r} 


and define, for a nonnegative integer t, the terms 


M{t) := 


OO 


E 

j=t+2 



V 


and 


C(a, r, TO, t) := i?(a, r, to, t). 


(2.26) 


(2.27) 


(2.28) 


Theorem 2.6. Assume that \rt +2 > 1 o-nd M(t) < c». Then, we have for every T >1 
|G(T)| < C{a,r,m,t) A{a,r,m,t,T) 


a 


= C{a,r,m,t) 


< log(2ri/“ -b l)[r-i logT -b {t + 1) log 2]*, 

T^/r[r-i logy + + 1) iog2]‘, 


r > a/m, 
r = a/m, 
r < a/m. 


(2.29) 


Proof. Let us show, for example, the last inequality in (12.291) where r < a/m. Let T > 1 be given. Observe that 

|G(r)| = |G*(T)|, (2.30) 


where 


^ m+i+1 oo N 

G*{T) := i (n,sO G x N^it) : ^max^n“ Y[ n] s"/ < T I, (2.31) 

f j=t+2 ^ 

and NJ°(t) denotes the set of all indices s' = (st+ 2 , Si- 1 - 3 , •■•) with Sj G N such that the set of j > t -b 2 with 
Sj ^ 1 is finite. Here, G* builds with (n, s') G x (t) on a different index splitting than G from (12.21) 

with (k, s) G Z™ X . This will allow for an easier decomposition later on. But their cardinalities are the 
same. 

Note that, for every (n,s') G G*{T), it follows from the definition 

H{T,t):= Js'GNr(t): TT s? < T I (2.32) 

1 J 
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1 . 


(2.33) 


that s' G H (T, t). Hence, 


|G*(r)| = ^ ^ 

s'eif(T,t) ngNm+t+l, (maxi<3<„,nj)“n7L'Uil"J < HJi t +2 *7 


We now fix a s' S NJ°(t) for the moment, and put 


Ts = T Y[ 


iGJ(s') 

where J(s') '■= {j G N : j > t + 2, Sj ^ 1}. Note that J(s') is a finite set by definition. We then have Tg' > 1 
and 


|G*(T)| = ^ | 77 (rg- 

s'eff(T,t) 


(2.34) 


where H{Tsi) is defined as in (12.161) . For ease of notation, we now use the abbreviation B := B{a,r,m,t). 
Lemma 1^31 for the case r < a/m gives 


\H{T,,)\ < BA{a,r,m,t,T,,) = H logTg, + (t + 1) log2]*. 

Hence, by (12.341) and with s' G N“(t), we have for every T > 1 that there holds 

|G*(r)| < ^ Hr,yMr-Mogrg, + (t + i)iog2]* 

s'GH(T,t) 


= ^ E 

s'GH[T,t) 


< HTi/’-[r-ilogT+(t+l)log2]* E n 

s'Gff(T,t) iGJ(s') 


(2.35) 


- 

1 /r 


/ \ 

T n G" 


r ^ log 

^ n +y+i)iog2 

iGJ(s') 



V leG(s') J 


(2.36) 


— Xvj 


where we used the inequality OjeJCs') < 1 in the last step. Next, let us estimate the sum in the last line. 
Note that, for every s' G it follows from definition (12.311) that Sj < j > t + 2. The condition 

M{t) < oo yields that —>■ oo as j —>■ oo. Hence, there exists j* such that Sj = 1 for every s' G H{T,t) and 
every j > j*. From this observation we get 


E n 

s'€H{T,t) iGJ(s') 


— Ar-j , 
< 


< 


E n 

j>t+2 i-‘+2 


— Xvj 


n E . 

f=*+2 Sj<T^^''3 , j>t+2 

The application of Lemma 12.21 gives 

OO OO 

Z = 1 + E < 1 

Sj —1 Sj —2 

Hence, by (j2.24l) . we get the inequality 


SHE 

j=t-\-2 Sj=l 


— Ar, 


Xrj - 1 V 2 


-(Ar-j-l) 


OO oo 

"j""' ^ n 

s'£H{T,t) j=t+2 j=t+2 


E n 


1+ 


Xrj - 1 \ 2 


-(Ar-j-l)' 




(2.37) 


(2.38) 
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which, together with (12.361) . proves the theorem for the case r < a/m. The other cases can be shown in a simiiar 
way. □ 

2.2. Index sets for mixed Sobolev-analytic-type smoothness. In this subsection we consider hy¬ 
perbolic crosses of a different type with the replacement of A(k, s) by p(k, s) in its definition, where p(k, s) 
now also involves exponentials in the s-dependent part. Such situations appear for example in applications 
with elliptic stochastic PDEs from uncertainty quantification. There, the arising functions are analytic for the 
stochastic/parametric y-part of the coordinates where, in many cases, a product structure still appears. In the 
x-coordinates we will keep our previous Sobolev-type setting, but in the y-coordinates we will switch to expo¬ 
nential terms involving certain weights in the exponents. Furthermore, the exponential terms are multiplied by 
a polynomial prefactor. To this end, let the 5-tuple m, a, r,p, q be given by 

m € N; a > 0; r = {rj)JL^, Vj > 0, j € N; p > 0, q > 0. (2.39) 

For each (k, s) £ Z™ x ZJ°, we define the scalar p(k, s) by 

OO OO 

p(k,s):= max (1-k |%|)“ ]^(1-kp|sj|)-'? exp((r, |s|)), (r, |s|) := ^ (2.40) 

l<J<m ^^ 

J=1 


Note that polynomial prefactors of the type (I + p\sj\)~^ indeed appear with values p = 2 and g = 1/2 in 
estimates for the coefficients of Legendre expansions in specific situations for stochastic elliptic PDFs under the 
assumption of polyellipse analytic regularity, see e.g. [i uni [13 E]. Also, more general forms of prefactors 
exist, involving factorials or the gamma function. Furthermore, one may consider individual values Pj,qj for 
each j. For reasons of simplicity, we stick to the case of constant p, q. Here and in what follows, |s| := (|sj |)^]^ 
for s £ Z . 

Now, for T > 0, consider the following hyperbolic cross in the infinite-dimensional case 

E{T):= {(k,s)£Z!/xZ“ :p(k,s)<r}. (2.41) 

Again, the cardinality of E{e~^) will later describe the necessary dimension of the approximation spaces of the 
associated linear approximation with accuracy e. We want to derive an estimate for the cardinality of E(T). 

Theorem 2.7. Let m £ N, a > 0, r = £ ]R°° with rj > 0 and let p = 0, q > 0. Assume that there 

holds the condition 


Mo,g(m) := ^ 


1=1 


— 1 


< OO. 


(2.42) 


Then we have for every T > 1 


\E{T)\ < Q)'’"exp[Mo.,(m)]T-/“. 


Proof. Let T > 1 be given. Observe that \E{T)\ = |F'*(r)|, where 

E*{T) := {(k,s) £ N"* X Z“ : p*{k,s) < T}, 

and 


(2.43) 


p*(k, s) := max exp W rjSj = max exp((r, s)). 

l<j<m \ I 

\j=i ) 

Thus, we need to derive an estimate for \E*{T)\. To this end, for s £ we put 

T, := ri/“exp[-(r,s)/a]. 


(2.44) 
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Note that, for every (k, s) G E*{T), it follows from the definition of E*(T) that s G H{T) where 


H{T) := : exp((r,s)) < T) . 


By definition and the symmetry of the variable kj we have 


\E^T)\ 


E 


E 


1 < m 


E 1 


sGH{T) maxi<j<^ kj < Ts 


sGH{T) km < Ts 

kj<km, 1 


< m E E 

seH{T) fceN: fc < Ts 


Hence, since Tg > 1, the application of Lemma 127^ gives 




seH{T) 


(Tg + 1/2)'" < m 

seHiT) 


- - 
m \2 


(Tg + rg/2)^ 




exp[-TO(r,s)/a]. 

se-H(T) 


(2.45) 


(2.46) 


(2.47) 


Note furthermore that, for every s G H{T), it follows from definition (I2.41|) that Sj < {\ogT)/rj, j G N. The 
condition Mo^q(m) < oo yields that rj —>■ oo as j —>■ oo. Hence, there exists a j* such that sj = 0 for every 
s G H{T) and every j > j*. From this observation we get 


E exp[-m(r,s)/a] < Y[ Y e'xp{—mrjSj/c 

seH{T) S 3 <(logT)/r,- 


J 

^ n 

i=i 


1 + Y^ exp{—mrjSj/a) 
By use of the inequality (I2.24|) we finally obtain the bound 


J P 

Y[[l + - l)-i 


i=i 


/ o\ 2m 

oo 

(^-j exp 

_i=i 


which gives the desired result. 

In order to estimate E{T) for the case p > 0, we need an auxiliary lemma. 
Lemma 2.8. Let rj > 0 and let p,q > 0. Assume that 


V > 


Q + yq 

P 


and ri > pq. 


(2.48) 


(2.49) 

□ 


(2.50) 


Then, we have 


^e-’''=(l+pfc)‘? < 




(2.51) 
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Proof. Set (p{x) := e -\-pxy. Let us first show that the assumption (12.501) provides the convexity of p on 
(0, oo). Changing variables by putting t = 1 +px, we have pix) = e^g{t), where S := rj/p and g{t) := 

Observe that the function g is convex for t > ■ Since the change of variables is linear and p > 0, this 

implies that the function tp is convex for x > Hence, for g > p is a non-negative convex 

function in (0, oo). 

By applying Lemma 12.11 we have 

OO «00 pV/P 

< / e-'>^(l+px)‘>dx = - / e-’’‘/Pt«dL 

Jll2 P Jl+p/2 


Observing that 


'l+p/2 Jl+p/2 


the integral in the last expression can be estimated as 

poo poo 

Jl+p/2 V V Jl+p/2 

poo 

V V Jl+p/2 


Hence, 


Summing up we obtain 


f d-p/2Y ^_(^/p)(i+p/2) 

Jl+p/2 ~ V-PQ 


+pkr < (1+p/2)% -W2 


which proves the lemma. □ 

Theorem 2.9. Let m G N, a > 0, r = {rj)fLi £ R°° with rj > 0 and let p, g > 0. Assume that there hold 
the conditions 


and 


O > 


q + yjqa/m 
P 


O > W J ^ N, 


(2.52) 


Mp^q{m) 


(1-b p/2)‘?’"/“ ^ 
j=i 


Q—fnrj/2a 

mrj/a — pqm/a 


< oo. 


(2.53) 


Then we have for every T > 1, 


\E{T)\ < 


/ o\ ^ rn 

(^-j exp[Mp.,(m)] r™/“. 


(2.54) 


Proof. As in the proof of Theorem 12.71 observe that \E{T)\ = |A‘*'(T)|, where 

E*iT) := {(k,s) £ N™ X Z- : p*(k,s) < T}, 
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and 


p*(k, s) := max fc“TT(l+pSj) exp ((r, s)). 

l<j<m 

Thus, we need to derive an estimate for \E*{T)\. To this end, for s G we put 

OO 

T, := exp[-(r,s)/a]. 

j=i 

In a completely similar way 
IE*(T)1 


to the proof of Theorem 12.71 we can show that 

2m oc 


< 


rj^mja 

i-1 


l+^(l+ps,)^-/“exp( —mrjSj /a) 


(2.55) 


(2.56) 


By use of Lemma 12.81 with 77 := mrjja and q := mqia., and the inequality (12.2411 . we continue the estimation as 


\E*(T)\ < - 


rpm/a 

i=i ■- 


< 


rfiTj j a — pqm/a 


rpm/a 


exp 


(1 + p/2)‘?™/“ ^ 


Q—mrj /2a 


mrj/a — pqm/c 


(2.57) 


which gives the desired result. □ 

Note at this point that the assumption m > 0 is crucial. For the case to = 0, our theorem would no longer 
give a rate in terms of T but merely a constant. Therefore, we shortly consider the case to = 0 with p = 0 in 
more detail. To this end, we first focus on the d-dimensional case, i.e. we consider 


EdiT) := {s G : exp((r,s)) < T}. 


We have the following bound for the cardinality \Ed(T)\: 
Lemma 2.10. For T > exp(rj), j = 1,..., d, it holds 


n 

Vi=i 


1 \ (logT)" 


rj I d! 


< \EdiT)\ < n 


d ^ \ (logT-bEjlwj) 


[rjj 


d! 


Proof. We have 


log I Y[ ^ r,s, < logT := f 

u=i / i=i 


(2.58) 


which describes just an index set which is a weighted discrete simplex in d dimensions of size T. Then we obtain 
with [5] the desired result. For further aspects and a slight improvement on the lower bound, see also [15]. □ 

This directly shows that we now only have a logarithmic cost rate in T, which is however exponential in 
the dimension d. Moreover, the order constant depends on d. Thus, we can not directly go to the infinite¬ 
dimensional limit d —^ OO. If we settle for a slightly higher cost rate instead, then, in certain cases, upper 
bounds can still be derived, which are completely independent of d and also hold in the inhnite-dimensional 
case. To this end, note that we need to resolve for a given T only up to a certain active dimension d = d{T) 


14 














since in the higher dimensions d + j,j > 0, we encounter just index values Sd+j = 0 due to the definition of 
E{T). Therefore, it holds Vj < logT, j = 1,... d. Then, we get 

d 

< dlogT. 
i=i 


Thus, with Lemma [2.101 using the lower bound of Stirling’s formula d\ > \/2TTd{d/eY and {{d + l)/d)‘^ < e, we 
obtain 




j=i ^ 


d\ 


n 


(d+l)" 


/ -) 

— 1 J 


i=i 




JL 1 


i=i 


(2.59) 


Now we consider the asymptotic behavior of the rj in more detail. For example, in the situation rj > e ■ j, 
we have 1 /l j < e ‘^/dl and get 


d 


n 


1 

Tj y/2TTd 


{\ogTf< 


e~d ed+^ 
d\ •\/27rd 


(logT)'^ 


e (logT)'^ 
y/2TTd d! 




i.e. we obtain a cost rate bound of ^T. In the situation Vj > e • we get analogously the bound 




e~d ed+^ 


{logT)d = 




\/27rd I d! 


< 


•\/27rd 


g(2VTHiT) ^ _^g(2VTHiT) 




which grows slower than any polynomial in T. If necessary, this bound can be further improved by a factor of 

1/VW- 

In the general case, we have the following lemma: 

Lemma 2.11. Let m = 0 and p = 0. Furthermore, let rj > wj’’, where uj,t > 0, and let 

Cuj,T := T + log > 0. 

Then, for the cardinality of the hyperbolic cross E(T) in the infinite-dimensional case, there holds the bound 


\E{T)\ < exp (logT)'/"). 


(2.60) 


Proof. Consider again the finite-dimensional setting from Lemma 12.101 From the assumption rj > wj’’ it 
follows that 




1=1 


1=1 


where d = d(T) again denotes the active dimension of E(T). Furthermore, since < logT it holds d < 
recall the upper bound from (12.5911 . By employing ^ < exp(x) we obtain for d > 1, i.e. for 
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log(T) > ri, the estimate 


|E,(r)| < n (logT)- = ^ 

Tj 'j2TTd 'j2TTdijj'^{d\Y uj^'J‘2.'iTd v d\ 

exp (r(log r)i/") = exp (r(log + dlog (^) ) 


D ^+1 


< 


oj^y/^jzd 
e 


y/27Td 
e 


exp|^r(logT)i/"+ ' log (^) 

(logT)!/" (^ + ^-i/nog(^)) 


— >- 

yhrd 

< exp (logT)^/ 


Therefore, this is also a bound on |i?(r)|. □ 

Altogether this shows a cost rate which is for r > 1 better than any algebraic rate and only slightly worse 
than any logarithmic rate0 Moreover, for 0 < r < 1, we get a meaningful estimate from our approach at 
all. This has to be compared to results which were derived elsewhere by means of Stechkin’s Lemma using so 
called p-summability and ^-admissibility conditions that are based on complex analytic regularity assumptions 
on polydiscs/polyellipses. In contrast to that, we only have to count the cardinality of the respective hyperbolic 
cross induced by T and the smoothness indices r. But we will have to use a Hilbert space structure (and not 
just a Banach space). Moreover, we have to assume a monotone ordering of the smoothness indices r to be 
given in the first place. 


2.3. Extensions. In the previous two subsections, we gave upper bounds for the cardinality of hyperbolic 
crosses in the infinite-dimensional case for the setting of nonperiodic mixed Sobolev-Korobov-type and nonpe¬ 
riodic Sobolev-analytic-type smoothness indices, i.e. we specifically considered the subsets G(T) C Z™ x 
and E{T) C Z™ x Z“, from (12.211 and (12.4111 . respectively, that involve only nonnegative values in k and s 
which reflects the nonperiodic situation. Of course, periodic situations can be dealt with in an analogous way 
which would involve the sets Z™ and ZJ“ instead. This will be discussed in this subsection. Here, altogether, 
four different combinations of Z™ or Z™ with Zjp„ or ZJ° are possible. This leads, in addition to the fully 
nonperiodic case which we already dealt with, to corresponding results for the fully periodic case and for the 
nonperiodic-periodic and periodic-nonperiodic counterparts. 

To simplify the presentation, we need some new notation. We use the letter I to denote either Z™ or Z™, 
and J to denote either Z“^ or Z^. Furthermore, we use the letter S to denote either K or A, i.e. the Korobov 
or the analytic setting. We then can define the hyperbolic crosses in the infinite-dimensional case 


G|x. 7 (T’) := {(k,s) elx As(k,s) <T} where S€{K,A). (2.61) 


Here, the scalars Aif(k, s) := A(k, s) and An(k, s) := p(k, s) are defined in (12.11) and (I2.40L respectively, with 
given and fixed corresponding parameters m,a,t,r,r,p,q. Furthermore, we denote by Jd the set of all s € J" 
such that supp(s) C {!,...,d}. With this notation we can identify Z'^ with J'd for J' = ZJ°, and Z^(. with J'd 
for J = Z“^. Then, we can analogously define the hyperbolic crosses and G^^j^lT) in the finite¬ 

dimensional case by replacing J with Jd in (12.6111 . respectively. We altogether obtain eight types of hyperbolic 
crosses for the infinite-dimensional case and eight types of hyperbolic crosses for the m + d-dimensional case 
which correspond to the different possible combinations. For example, for the index sets of nonperiodic mixed 
Korobov-type and nonperiodic analytic smoothness, we now have (T) = G(T) and (T) = E{T) 

with G{T) and E{T) from (12.21) and (I2.4ip . respectively. 


^Or, vice versa, with cost M = \E{T)\ and thus T > exp , this gives a bound e < exp(—Ctj,r(logM)’^) for the 

accuracy e = T~^ that is obtained for fixed cost M. Thus, we obtain a rate for the approximation error which is for t > 1 better 
than any algebraic rate and is only slightly worse than any exponential rate. For 0 < r < 1, we get a meaningful rate at all. 
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We now can formulate the results on the estimation of j(r)| and \Gx^j{T)\. To this end, let us define 
the following quantities which depend on the parameters m, a, t, r, r,p, q and T: 


A^{T) := 


f A(a,r,m,t,r), 

\ ' 


S = K, 
S = A, 


and 


:= 



S = K, 
S = A, 


(2.62) 


with A{a,r,m,t,T) from (12.151) . M{t) from (12.271) and Mp^q from (12.421) for p = 0 and from (12.531) for p > 0. 
Furthermore, let us dehne 


exp {M^) B{a,r, 771, t), 

2™ exp {M^) B{a, r, rn, t), 
exp (2M'®) B{a, r, m, t), 

2™ exp (2M'®) B{a, r, tti, t) 
(3/2)2"* exp (M^), 

2™ (3/2)2"* exp (M^), 
(3/2)2"* exp (2M^), 

2"* (3/2)2"* exp (2M^), 


S = K, I = Z^, J = 

S' = iF, I = Z”*, 57 = Z“ , 
S = K, I = J = Zf, 

S'= TC, I = Z”*, J = Zf, 

s = A 1 = 2™, :r = z-, 

S = ^, I = Z"*, = 

S = ^, I = Z!p, J = Z^, 
S = A, I = Z”*, = Z“, 


with B{a,r,m,t) from f2.14l) . 

We are now in the position to state a generalized theorem which covers all different possible cases. 
Theorem 2.12. For the case S = K, let the triple m,a,r be given as in (12.251) . and, for the case S = A, let 
the 5-tuple m,a,r,p,q be given as in (12.391) . Suppose that there hold the assumptions of Theorem \2. 61 if S = K, 
and the assumptions of Theorem \2.7\ if S = A, p = 0, and of Theorem \2M if S = A, p > 0. Then, we have for 
every T > 1 

\GLjAT)\ < \Gl,,jiT)\ < G^^jA^iT). (2.64) 

We here refrain from giving explicit proofs since they are similar to these of the last two subsections involving 
just obvious modihcations. 

We finish this section by giving a simple lower bound for |Gxxj'd(^)l l^ixy(^)l' 

Theorem 2.13. For the case S = K, let the triple m,a,r be given as in (12.251) . and, for the case S = A, 
let the 5-tuple m,a,v,p,q he given as in ()2.39l) . Then, we have for every T >1 

\GLj{T)\ > |G|^jJT)| > \TG-\r-. (2.65) 

Proof. It is sufhcient to treat the case I = Z!(*, fid = Z’^. To this end, we consider the set Q of all elements 
(k, 0) G Z™ X Z'^ such that kj < T^/°- — 1, j = 1, Then, Q is a subset of (T) for T > 1. Hence, 

the obvious inequality IQI > proves the assertion. □ 

3. Hyperbolic cross approximation in infinite tensor product Hilbert spaces. In this section, we 
present the basic framework for our approximation theory in the infinite-dimensional case which is based on 
infinite tensor product Hilbert spaces. Then, we consider specihc instances of our general theory and define the 
mixed Sobolev-Korobov-type and mixed Sobolev-analytic-type spaces mentioned in the introduction. 

3.1. Infinite tensor product Hilbert spaces and general approximation results. We recall the 
notion of the inhnite tensor product of separable Hilbert spaces. Let Hj, j = be separable Hilbert 

spaces with inner products (•,-)j. First, we define the hnite-dimensional tensor product of Hj, j = l,...,m, as 
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the tensor vector space i/i 0 i /2 ® ® i^m equipped with the inner product 

m 

■= W{4>3^i^])3 for all e Hj. (3.1) 

1=1 

By taking the completion under this inner product, the resulting Hilbert space is defined as the tensor product 
space iJi 0 i /2 0 • • • 0 Hm of Hj^ j = 1, Next, we consider the infinite-dimensional case. If Hj,j G N, is 

a collection of separable Hilbert spaces and j € N, is a collection of unit vectors in these Hilbert spaces then 
the infinite tensor product is the completion of the set of all finite linear combinations of simple tensor 

vectors 0jgN</'j where all but finitely many of the (^^ ’s are equal to the corresponding The inner product of 
0jgN(^_,- and 0jgp}^j is defined as in (I3T|). For details on infinite tensor product of Hilbert spaces, see [7]. 

Now, we will need a tensor product of Hilbert spaces of a special structure. Let Hi and H 2 be two given 
infinite-dimensional separable Hilbert spaces. Consider the infinite tensor product Hilbert space 

C:= where iJ™ := 0™ ^iJi, := ®%iH 2 . (3.2) 

In the following, we use the letters /, J to denote either Z+ or Z. Recall also that we use the letter X to 

denote either Z™ or Z™ and the letter J to denote either Z^^ or ZJ°. Let and {4>2,s}s€J be given 

orthonormal bases of Hi and iL 2 , respectively. Then, {^!>i,k}kei and {^ 2 .s}sGy are orthonormal bases of iJ™ 
and H^, respectively, where 

■= ®]Ll4’l,kj, 4>2,s ■= 0^i</'2,S3- (3.3) 

Moreover, the set {(/>k,s}(k,s)Gixy is an orthonormal basis of £, where 

0k,s •— 01,k 0 02,s- (3-4) 

Thus, every f G C can by represented by the series 

/ = X! /k.s0k.s, (3.5) 

(k,s)GXx*/ 

where /k.s := (/, 0k,s) is the (k, s)th coefficient of / with respect to the orthonormal basis {0k.s}(k.s)eixy- 
Furthermore, there holds Parseval’s identity 

ml = E i/k,sp- (3.6) 

(k,s)GXxX 


Now let us assume that a general sequence of scalars A := {A(k, s)}(i(..s)Gixy with A(k, s) ^ 0 is given. Then, 
we define the associated space as the set of all elements f G £ such that there exists a g G C such that 


/:= 


E 

(k,s)GXxX 


^k.s 

A(k,s) 


0k,s ■ 


(3.7) 


The norm of is defined by ||/||£> := ||ff||c. From the definition (13.7|) and Parseval’s identity we can see that 

wfwh = E iA(k,s)n/k,.r (3.8) 

(k,s)GXxX 

We also consider the subspace £d in £ defined by £d ■= |/ = J2(ks)&xxJd /k,s0k,s| and the subspace £^ := 
£^ (~1 £d, where Jd ■= {s G J : supp(s) C {I, • • • , 0} }. 

Next, let us assume that the general nonzero sequences of scalars A := {A(k, s)}(k,s)eixy and ly := 
{r^(k, s)}(k, s)£ixj are given with associated spaces £^ and £'' with corresponding norms and subspaces £^ 
and £(). For T > 0, we define the set 

Gixy(T):= {(k,s)elx J7: ^^<r}, (3.9) 
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and the subspace 'P{T) of all 5 € £ of the form 


9 — ^ ' ffk,s 0 k,s- 

(k,s)GGzxj(T) 


(3.10) 


We are interested in the /I'^-norm approximation of elements from by elements from ViT). To this end, for 
f G C and r > 0, we define the operator St as 


‘5t(/) := ^ /k.s0k,s- (3-11) 

(k,s)GGixj(T) 

We make the assumption throughout this section that GixjiT) is a finite set for every T > 0. Obviously, St 
is the orthogonal projection onto V{T). Furthermore, we define the set GixJdiT), the subspace Vd{T) and the 
operator Sd,T{f) hr the same way by replacing J by Jd- 

The following lemma gives an upper bound for the error of the orthogonal projection St with respect to the 
parameter T. 

Lemma 3.1. For arbitrary T >1, we have 

||/-5T(/)|k‘' < T-^f\\c., WfeC^nr. (3.12) 

Proof. Let f G DC'. From the definition of the spaces and C' and the definition (13.81) of the associated 
norms ||.||£a and ||.||£‘', we get 


Wf-STifWc 


i^"(k,s)n/k.s 

(k,s)^Gix.7(r) 


< sup 

(k,s)^Gix.7(T) 


A(k,s) 


I^(k,s) 


-2 


l^(k,s)p|/k,s 

(k.s)^Gixj(T) 


< T“ 


1^- 


□ 

Now denote by the unit ball in i.e., := {f G ||/||£x < 1}, and denote by the unit ball in 

£^, i.e., := {f G : ||/||£> < !}• We then have the following corollary: 

Corollary 3.2. For arbitrary T > 1, 

sup inf I1/-5IU-' = sup ||/-5 t(/)||£- < T"^ (3.13) 

Next, we give a Bernstein-type inequality. 

Lemma 3.3. For arbitrary T > 1, we have 


WfWc- < TWfWc^, yfGViT). (3.14) 

Proof Let / G V{T). From the definition of and CP and the definition (13.81) of the associated norms ||.||£a 
and ||.||£i^, it follows that 


1^^ = 


XI i^(k,s)n/k,s 

(k.s)GGix.7(r) 


< sup 

(k.s)GGix.7(T) 


A(k,s) 


i^(k,s) 


X ii^(k,s)n/k,s 

(k,s)GGxxj(T) 


< tWc^. 
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□ 

Now we are in the position to give lower and upper bounds on the e-dimension rieiU^, C^). 

Lemma 3.4. Let e € (0,1]. Then, we have 

|Gixj(l/e)|-l < n,{U\r) < \Gx^j{l/e)\. (3.15) 


Proof. Put T = 1/e and let 


B{e) ■.= {f&r{T):\\f\\c^<e}. 

To prove the first inequality, we need the following result on Kolmogorov n-widths of the unit ball [sa Theorem 
1]: Let Ln be an n-dimensional subspace in a Banach space X, and let Bn{S) := {f £ Ln : \\f\\x < S}, S > 0. 
Then 


dr^-i{B^{S),X) = 6. (3.16) 

In particular, for n := dim'P{T) = |Gxxer(l/e)|, we get 


d^.i{B{e),r) = e. 


(3.17) 


Note furthermore that the definition (HD of the Kolmogorov n-width does not change if the outer infimum is 
taken over all linear manifolds Mn in X of dimension n instead of dimension at most n. Hence, for every linear 
manifold M„_i in C' of dimension n — 1, equation (13.171) yields 


From Lemma l3.31 we obtain 


sup 

feB{6) 


inf 

gGM„_i 


Wf-gWc- > £■ 


B{e) C U^, 


(3.18) 


which gives 


n,.{fA^,Cy) > ns{B{e),C'^) > sup < n': V M„/ : dimM„/< n', sup inf ||/— gUz;*' > £ > . 

[ f€B(e) 9&M^' J 

Here, M„/ is a linear manifold in of dimension < n'. Altogether, this proves the first inequality in (13.151) . 
The second inequality follows from Corollary 13.21 □ 

In a similar way, by using the set Gxxjd(T), the subspace Vd{T) and the operator Sd,Tif), we can prove 
the following lemma for ne{bl^,C'f). 

Lemma 3.5. Let e € (0,1]. Then we have 

|Gxx.y.(l/£)|-l < < \Gx^jAl/e)\. (3.19) 


3.2. Results for mixed Sobolev-Korobov-type and mixed Sobolev-analytic-type spaces. So 

far, we laid out the basic framework for our theory in the infinite-dimensional case, where the error of an 
approximation is measured in the ||.||£i'-norm and the functions to be approximated are from the space with 
associated, given general sequences v and A. In the following, we will get more specific and we will plug in 
particular sequences v and A. They define the Sobolev-Korobov-type spaces and Sobolev-analytic-type spaces 
mentioned in the introduction, whose indices were already used for the definition of the hyperbolic crosses in 
Section[2l To this end, we will use Sobolev-type spaces for Korobov-type spaces for i7“, and analytic-type 
spaces for in (13.21) . 

First, for given a > 0, we define the scalar Am,c«(k;), k € I, by 

Am.a(k) := max (1 -k \kj\)°‘. 

l<j<m 
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(3.20) 






Recall the definition (13.2|) . The Sobolev-type space K'^ is then defined as the set of all functions / € snch 
that there exists a g € such that 


/ = E 


5k 


kGX 


^m,OL (k) 




(3.21) 


where := (g, ^i,k) is the kth coefficient of g with respect to the orthonormal basis {'('i.kjkGi- The norm of 
is defined by 


ll/lk<^ :=ll-7lk- (3.22) 

Second, for given r G we define the scalar Pr(s), s G JT", by 

OO 

Pr(s):= + (3-23) 

i=i 

Recall the definition (13.21) . The Korobov-type space is then defined as the set of all functions / G such 
that there exists a 5 G such that 

(3.24) 

where gs '■= {g, 4’2,s) is the sth coefficient of g with respect to the orthonormal basis {(/) 2 ,s}sg The norm of 
is defined by 


WIWk^ :=ll5ll£. (3.25) 

Third, for given r G K+, p,q>0, we define the scalar pr^p^q{s), s G J,hy 

00 00 

Pr.p,,(s) := ]^(l-fp|sj|)-« exp((r, |s|)), (r, |s|) := (3.26) 

i=i i=i 

The analytic-type space and its norm are then defined as in (13.241) and (13.251) by replacing Pr(s) with 

Pr,p.<j(s). Note at this point that the spaces NT", K’^ and are themselves Hilbert spaces with their naturally 

induced inner product. This means that if g,g' represent /,/' as in (13.221) or (I3.25L then (/,/') := {g,g')- 
For a > f3 > 0, we now define the spaces G and H by 

g:=KP®H^ 'H:=K°‘®F, where F is either RT"’or (3.27) 

Here, is given in (13.2|) . The space % is called Sobolev-Korobov-type space if F = A"'’ in (j3.27|) and Sobolev- 
analytic-type space if F = From these definitions we can see that G and T-L are special cases of C in (13.21) . 

Moreover, 


G = CA, where 1 /:= {^(k,s)}(k,s)Gixj', i^(k, s) := A,„,;3(k). (3.28) 

Furthermore, denoting by S either K ox A (cf. Subsection 12.31) . we see that 

n = where A := {A(k,s)}(k,s)Gixj, A(k,s) := As(k,s), (3.29) 

where As(k, s) = Am,a(k)pr(s) if 5 = F and As(k, s) = Am,a(k)pr,p, 5 (s) if S' = H, respectively. We also consider 
the subspaces Gd ■= G r\ Cd and Hd '■='HC\ Cd- 

We are now in the position to state the properties of the hyperbolic cross approximation of functions from 
T-L with respect to the C^-norm. To this end, we fix the parameters m,a, f3,r,p,q in the definition of G and 'H, 
and put a = a — p. We will assume that, for S = K, the triple m, a, r is given as in (I2.25P and, for S = A, the 
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5-tuDle m. a. r. v. a is eiven as in (12.391). Denote bv U the unit ball in H. i.e.. U ■.= \ f € V. :||/ll« < 1}, and by 
Ud the unit ball in i.e., Ud '■= {/ £ T-Ld ■ WfWu < !}• Then, from Corollary 13.21 Lemmata 13.41 and 13.51 and 
Theorems 12.121 and 12.131 we obtain the following result: 

Theorem 3.6. Let a > /3 > 0, let a = a — 13, let, for S = K, the triple m, a, r be given as in (12.251) . and let, 
for S = A, the 5-tuple m,a,r,p,q be given as in (12.391) . Suppose that there hold the assumptions of Theorem 
\2.6] if S = K, and the assumptions of Theorem \2.7\ if S = A, p = 0, and Theorem \2.9\ if S = A, p > 0. Then, 
we have for every d £ N and every e £ (0,1] 

< ne{Ud,Qd) < ne{U,g) < Ci,,jA^{e-^), (3.30) 

where and A^{T) are as in (12.631) and (12.621) . respectively. Moreover, it holds 

sup ||/-5d,,,-i(/)||e^ < sup||/-55-i(/)||e < e. (3.31) 

/6Wd feu 

4. Hyperbolic cross approximation of specific infinite-variate functions: Two examples. In 

this section, we make the results of the previous section for hyperbolic cross approximation of infinite-variate 
functions more specific. We will consider two situations as examples: First, the approximation of infinite- 
variate periodic functions from Sobolev-Korobov-type spaces and, second, the approximation of infinite-variate 
nonperiodic functions from Sobolev-analytic-type spaces. Note that the other possible cases can be treated in 
an analogous way. 

4.1. Approximation of infinite-variate periodic functions. Denote by T the one-dimensional torus 
represented as the interval [0,1] with identification of the end points 0 and 1. Let us define a probability measure 
on T°°. It is the infinite tensor product measure p, of the univariate Lebesgue measures on the one-dimensional 
T, i.e. d/r(y) = Here, the sigma algebra S for p. is generated by the periodic finite rectangles 

Ojez ^3 where only a finite number of the Ij are different from T and those that are different are periodic 
intervals contained in T. Then, (T°°,S,/r) is a probability space. 

Now, let L 2 {T°°) := L 2 {T°°,fi) denote the Hilbert space of functions on equipped with the inner product 
if^g) ■= /too /(y) 5 '(y) dn{y). The norm in L 2 (T°°) is defined as ||/|| := (/, /)^/^. Furthermore, let L 2 (T™) be 
the usual Hilbert space of Lebesgue square-integrable functions on T™. Then, we set 

L2(T™ X T“) := L2(T”") 0 L2(T“). 

Observe that this and other similar definitions become an equality if we consider the tensor product measure 
in T'" X T°°. For (k, s) £ x ZJ°, we define 

m 

e(k,s)(x,y) := ek(x)es(y), ek(x) := efc^.(a;j), es(y) := 

j=l jGsupp(s) 

where es{y) := Note that {e(k,s)}(k,s)GZ™xZ“ is an orthonormal basis of L 2 (T™ x T°“). Moreover, for 

every / £ L 2 (T'" x T°“), we have the following expansion 

/= /(k,s)e(k,s), 

where, for (k, s) £ Z™ x ZJ“, /(k, s) := (/, e(k.s)) is the (k, s)th Fourier coefficient of /. Hence, putting 
Hi = H 2 = L 2 (T), we have 

L2(T”" X T°°) = £ := iL™ 0 H^. 

Next, based on the orthonormal bases {4>i,k}kei ■= {efcjfcGZ and {4>2,s}seJ ■= {es}sez for the two spaces Hi 
and H 2 in (|3.2|) with I = J = Z, respectively, we construct the associated Sobolev-type spaces iF^(T'" x T°°) 
and the associated Sobolev-Korobov-type spaces K'“’'’(T"* x T°°) for the periodic case as 

X T“) := g, A“’'’(T'" X T“) := U, 
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where Q and 'H are definec@ as in (13.271) with F = and the triple m, a, r as in (12.251) . Furthermore, we set 


^ X T“) := Hd. 

For T > 0, let us denote by T(T) the subspace of trigonometric polynomials g of the form 

9-= X] 5(k,s)e(k,s), 

(k.s)GGf„,,^j„(T) 

where 


Gf.xzr(^) e z™ X zr : AK(k,s) < T}, 

and, with a = a — (3, 

t-\-l OO 

AiG(k,s):= max (l + |fcj|)“]^(l + |sj|)’' (l + |sj|)’'G 

“ j=t+2 

For / G L 2 (T™ X T°°) and T > 0, we define the Fourier operator St as 

StU) ■■= X /(k,s)e(k.s)- 

(k,s)eGf™,^^j„(T) 


(4.1) 


(4.2) 


Let {/“’'■ (T™ X T“) := U and 17“’'’(T'" x T“) := Ud be the unit ball in x T°°) and it:“’'’(T™ x T'^), 

respectively. Now, from Theorems l3. 61 l^d^ and l^d^ the results on the hyperbolic cross approximation in infinite 
tensor product Hilbert spaces of Section [3] can be reformulated for the approximation of periodic functions in 
Sobolev-Korobov-type spaces as follows. 

Theorem 4.1. Let a > /? > 0, let a = a — (3 and let the triple m,a, r be given as in (I2.25|) . Suppose that 
there hold the assumptions of Theorem \2.6\ With 

n,{d) := ne(t/rf’'’(T™ x T~),iF^(T’" x T“)), := ne(G“’'’(T™ x T“),iL'^(T™ x T°°)), 


we have for every d G N and every e G (0,1] 

1 < n^{d) < He < GT(£-1), 

where C := 2™ B{a — (3, r, m, t) with M{t) from (12.271) and B{a, r, m, t) from (12.141) . and 


A{T) 


'j.m/(a-/3)^ r>(a-l3)/m, 

< T™/(“-^)log(2Ti/(“-^) + l)[r-Mogr+(t + l)log2]*, r = {a-^)lm, 
logT + (t + 1) log2]‘, r < {a — l3)/m. 


(4.3) 


Note at this point that we discussed here only the example involving the Sobolev-Korobov-type space. The 
Sobolev-analytic-type space as well as other combinations for the periodic case can be defined and dealt with 
in an analogous way if necessary. 


®At this point, note a slight abuse of notation. In 113.2711 . the only relates to HJ”. 
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4.2. Approximation of infinite-variate nonperiodic functions. In the following, we consider the 
nonperiodic case in more detail. Here, we focns on two types of domains, R and I := [—1,1]. To this end, we 
use the letter D to denote either I or R. Let us define a probability measure n on . For D = I, a probability 
measure on is the infinite tensor product measure ji of the univariate uniform probability measures on the one¬ 
dimensional I, i.e. d/r(y) = For D = R, a probability measure on R°° is the infinite tensor product 

measure /i of the univariate Gaussian probability measure on R, i.e. d^(y) = exp{—yj/2)dyj. 

Here, the sigma algebra S for y is generated by the finite rectangles where only a finite number of 

the Ij are different from ID) and those that are different are intervals contained in D. Then, (ID)°°, S,//) is a 
probability space. 

Now, let L 2 {V)°°,fi) denote the Hilbert space of functions on equipped with the inner product {f,g) := 
/jjoo /(y)ff(y) d^(y). The norm in L 2 (D°“,//) is defined as ||/|| := (/,/)^^^. In what follows, y is fixed, and for 
convention, we write L 2 {V)°°,y) := T 2 (D°°)- Furthermore, let ^2(1’") be the usual Hilbert space of Lebesgue 
square-integrable functions on I™ based on the univariate normed Lebesgue measure. Then, we define 

L2(r" X D“) := L2(I"") 0 L2(D“). 

Let family of univariate orthonormal Legendre polynomials in L2(1I) and let be the 

family of univariate orthonormal Hermite polynomials in L 2 (R, u) with associated univariate measure du(y) := 
(27r)-i/2exp(-2/V2)dj/. We set 


{</>!,fc}feGZ+ := {^fc}fcGZ+, and 
For (k, s) G Z™ X , we define 

0(k,s)(x,y) := (/>i,k(x)02,s(y), (/>i,k(x) 


{02,s}sGZ+ 




•= </> 2 ,s(y) := 


]D) = I, 
D = R. 


jGsupp(s) 


(4.4) 


Note that {(()(k.s)}(k,s)GZ™xZ“ is an orthonormal basis of ^2(1™ x ]D>°°). Moreover, for every / G ^2(1”^ x ]D>°°), 
we have the following expansion 

f ^ ^ yk,s0(k,s); 

(k,s)GZ:pxZ“, 


where for (k, s) G Z™ xZI)f(,, /k.s := (/, ^!'(k.s)) denotes the (k, s)th coefficient of / with respect to the orthonormal 
basis {(/>(k,s)}(k,s)GZ:pxZ“ ■ Hence, by putting Hi = ^ 2 ( 1 , ^dx) and H 2 = L 2 (D), we have 

^2(1™ X D“) = C:= 0 H^. 


Next, based on the orthonormal bases {(j)i.k}k^i and {(j) 2 ^s}sej for the two spaces Hi and H 2 in (13.21) 
with / = J = Z+ as defined in (14.41) . respectively, we construct the associated Sobolev-Korobov-type spaces 
X D°“) and the associated Sobolev-analytic-type spaces ^“■''’^’’'^(1™ x D°“) for the nonperiodic case as 

^ poo) _ ^ poo) _ 

where Q and % are definecH as in (13.271) with F = and the 5-tuple m, a, r,p, q as in (12.391) . Furthermore, 

we set 

X ID°°) := Gd, X ID°°) := Hd- 


®Note again a slight abuse of notation here. In (13.2711 . the only relates to 
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(4.5) 


For T > 0, we denote by V^{T) the subspace of polynomials g of the form 

9 •“ ^ ^ ffk,s</>(k,s): 

where 

m := {(k,s) e Z™ X Z- : A^(k,s) < T}, (4.6) 

and 

oo oo 

AA(k,s):= max (1 + %)“ ]^(l+psj)"« exp((r,s)), (r, s) := ^ r^s^-. (4.7) 

i=i i=i 


For / G L 2 (I™ X D°°) and T > 0, we define the operator as 

5#(/):= E /ks<(>(k.s). (4.8) 

(k,s)GG,Apx^~ (G 

Let [/“’'■’P’9(I™ X ID)“) := U and [/“’‘■’P’9(l”i x D“) := Ud be the unit ball in A“’''’P’9(I"' x ]D)°°) and ^“■'■’^’9(1™ x 
]D)°°), respectively. Now, from the Theorems 13.61 [^TT^ and B.131 the results on hyperbolic cross approximation 
in infinite tensor product Hilbert spaces of Section [3] can be reformulated for the approximation of nonperiodic 
functions in Sobolev-analytic-type spaces as follows. 

Theorem 4.2. Let a > j3 > Q, let a = a — jS and let the b-tuple to, a,r,p, g he given as in (12.3911 . Suppose 
that there hold the assumptions of Theorem \2.7\ if p = 0, and the assumption of Theorem \2.9\ if p > 0. With 

n,{d) := ne(C/7’“’''’^’'^(I"' x x D““)), := ne(G"'’“’'’’P’9(I”' x x ID)°°)) 

we have for every d G N and every e G (0,1] 

L£-i/(“-'^)J™-1 < ne[d) < Ue < (3/2)™exp(Mp,(4.9) 

where Mp^q is as in (12.4211 for p = 0, and as in (12.5311 for p > 0. 

Note at this point that we discussed here only the example involving the Sobolev-analytic-type space. Other 
combinations can be defined and dealt with in an analogous way. 

5. Application. We now give an example of the application of our approximation results in the field of 
uncertainty quantification. We focus on the notorious model problem 


- divx(cr(x,y)VxM(x,y)) =/(x) x G I™ y G (5.1) 

with homogeneous boundary conditions u(x,y) = 0, x G i9I™, y G 10)°“, i.e. we have to find a real-valued 
function u : I™ x —>■ R such that (15.111 holds /i-almost everywhere, where D°“ is either or R°“ and 

pL is the infinite tensor product probability measure on defined in Subsection 14.21 Here, I™ represents 
the domain of the physical space, which is usually to = 1,2,3-dimensional, and D°“ represents the infinite¬ 
dimensional stochastic or parametric domain. We assume that there holds the uniform ellipticity condition 
0 < Omin < o'(x, y) < Umax < OO for X G I™ and p-almost everywhere for y G 15““. In a typical case, (T(x,y) 
allows for an expansion (T(x,y) = d(x) + ^^^ tjjj{x.)yj, where a G Loo(I™) and {tpj)jL-^ C Loo(I™). A choice for 
('0i)^i ia sPDEs is the Karhunen-Loeve basis where u is the average of u and the pj are pairwise decorrelated 
random variables. Another situation is the case, where the logarithm of the diffusion coefficient (t(x, y) can be 
represented by a centered Karhiinen-Loeve expansion (t(x, y) := exp ■ 

Note here that u{x,y) can be seen as a map w(-, •) : 1!)““ —>■ i7^(I™) of the second variable y. Usually, for 
the elliptic problem (15.IL we consider the smoothness indices /3 = 0 or /3 = 1. In general, the solution u lives 
in the Bochner space 


Lp(D““,iJ^(I™)) := ^ i7^(I™) : 
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id//(y) < oo 












(with a natural modification for p = oo), where is the Sobolev space of smoothness /3. For reasons 

of simplicity, we restrict ourselves to the Hilbert space setting and consider p = 2. Then, since is a 

Hilbert space as well, L 2 (D'^, ^^^(1"*)) is isomorphic to the tensor product space (g) L 2 {'D°°) and we can 

measure u in the associated norm || • ||_fr/3(im)(g)L2(D“)- 

Furthermore, depending on the properties of the diffusion function a(x,y) and the right hand side /(x), we 
have higher regularity of u in both, x and y. While we directly may assume that u{-,y) is in _H“(r"),a > /3, 
pointwise for each y, the regularity of u in y needs further consideration. It is known that, under mild 
assumptions on cr(x, y), the solution of (15.11) depends analytically on the variables in y, see e.g. [21151 [T?l ITIF 
Moreover, there are estimates that show a mixed-type analytic regularity of u in the y-part, i.e. we indeed havqj 
m(x, •) G For the simple affine case with a product Legendre expansion, this will be discussed in more 

detail in the appendix. For estimates on the expansion coefficients, see e.g. [14], formula (4.9), [13], section 6, or 
m, subsection 1.3.2, for the case of uniformly elliptic diffusion and [55] for the case of log-normally distributed 
diffusion, and see also [iEI]. Analogous estimates and derivations hold (after some tedious calculations) for 
more complicated non-affine settings and diffusions, see, e.g. dni EH, provided that corresponding proper 
assumptions on a(x,y) and thus on m(x, y) are valid. 

In addition, and this is less noticed, we also have a mixed-type regularity of u between the x— and the y—part. 
To be precise, a calculation following the lines of [2] which involves successive differentiation of dSI]) with respect 
to y reveals that the solution u belongs to the Bochner space A'’’P’'J(D°°, iJ“(I'”)) provided that a{x,y) and 
/(x) are sufficiently smooth. Since A'’’P’'J(]D>°“, iJ“(I”*)) is isomorphic to 0 A''’P’'?(D°°) we indeed have 

mixed regularity between x and y. In the end, this is a consequence of the chain rule of differentiation with 
respect to y and the structure of the sPDE (El]) which involves derivatives with respect to x only. If there is 
not enough smoothness, then A'’’P’'J(D°°) has to be replaced by A"'’(]D>°°) (with some different r), but the mixed 
regularity structure between x- and y-part remainsU Thus, we first consider the case where u{x, •) is in a 
space of analytic-type smoothness r,p,q for each x with certain smoothness indices v^p,q. Then, we consider 
the case where it(x, •) is in a space of Korobov-type smoothness r. 

In what follows, we keep the notation of Sections [5] and 01 and in particular, the notation of Subsection 14.21 
Let a>l3>0, a = a — P and the 5-tuple m, a, r,p, q be given as in (I2.39|) . For convenience, we allow, again by 
a slight abuse of notation, for the identification 

K^(I™xD°°) = A:^(I™)0L2(»°°) = iL'^(I™)0L2(]D>°°) 

and allow for u to belong to the space of analytic-type smoothness 

X D°°) = a:“(I™) 0 A'’’P’‘?(D°°) = iJ“(I’") 0 A'’’P’«(D~) 

We then are just in the situations which we analyzed in Subsection l4.2l Let us combine Theorems l3.6ll2.7l and l2.9l 
and reformulate them in a more conventional form. Taking the hyperbolic cross G^{T) := (T) = E(T) 

as in (12.411) and (14.6L using the orthogonal projection as in (14.81) and putting n := \G^(T)\, we redefine 
as a linear operator of rank n 

L„ : K^(I^) 0 L2(D~) ^ V^iT), 

where V^{T) is defined by (14.51) . Suppose that there hold the assumptions of Theorem 12.71 if p = 0, and 
the assumptions of Theorem 12.91 if p > 0. From Theorems ElO and El we obtain an error bound of the 
approximation of the solution u by as 

||m - Ln(w)|k/3(i™)®L2(D“) < 2““^ exp[ (a - /3) Mp^q/m] 

Next, we consider the case where u(x, •) is only in a space of Korobov-type smoothness r. To this end, recall 
the details of Subsection l4.2l Again, based on the orthonormal bases {4>i,k}k£i and {(j) 2 ,s}s£j for the two spaces 

^Consequently, there is here no issue with our specific choice of norm as in m- 

^The determination of r from e.g. the covariance structure of cr(x, y) is however not an easy task. In general, a direct functional 
map from the covariance eigenvalues (if allocatable) to the sequence r is not available at least to our knowledge, and only estimates 
can be derived. 
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Hi and H 2 in (13.21) with / = J = Z+ as defined in (14.41) . respectively, we construct the Korobov-type spaces 

^ JJOO) _ X ID°°) := -H, 

where Q and H are defined as in (|3.27l) with F = Kr“’'’ and the triple m, a, r is from (12.251) . 

For T > 0, we denote by V^{T) the subspace of polynomials g of the form 

9 ~ 'y ' 5k,s</'(k,s); (5-2) 

(k,s)GG*^(T) 

where 

G^(T) = (r) := {(k,s) G Z- X Z^ : AK(k,s) < T}, (5.3) 

and 


00 

Aif(k,s) := max (1 |fcj|)“ ]^(1 -h SjfF 

l<j<m 


For / G F2(1I™ X ID°“) and T > 0, we define the operator 5^ as 

5f(/):= ^ /k.s0(k.s). (5.4) 

(k,s)GG^^(T) 

Then, we see from Theorem 13.61 that for arbitrary T > 1 

ll/-5f(/)lk^(i™)®L.(D~) < V/GK“’-^(I'"xD~). (5.5) 

On the other hand, let a > /3 > 0, let a = a — /? and let the triple m, a, r be given as in (I2.25F Suppose that 
there hold the assumptions of Theorem 12.61 and moreover, r > (a — j3)/m. Then, we have by Theorem 12.61 for 
every T > 1, 

|G^(r)| < (5.6) 

where G := C{a,r,m,t) is as in (12.281) (and with G^{T) = G{T) in (12.21) 1. Setting n := |G^(T)|, we redefine 
the orthogonal projection as a linear operator of rank n 

Ln : K^{r^) 0 L2(D“) ^ r^{T). 

From (15.51) and Theorem 12.61 we obtain an error bound of the approximation of u by as 
||u — L„(u)|1x/3(i™)®l 2(B“) < ||M||K“(i'")ig)A:>-(D“)- 

Note finally that the results in this section can be extended without difficulty to the periodic setting or to mixed 
periodic and nonperiodic settings of (Ell. 

6. Concluding remarks. In this article we have shown how the determination of the e-dimension for 
the approximation of infinite-variate function classes with anisotropic mixed smoothness can be reduced to 
the problem of tight bounds of the cardinality of associated hyperbolic crosses in the infinite-dimensional 
case. Moreover, we explicitly computed such bounds for a range of function classes and spaces. Here, the 
approximation was based on linear information. The obtained upper and lower bounds of the er-complexities 
as well as the convergence rates of the associated approximation error are completely independent of any 
parametric or stochastic dimension provided that moderate and quite natural summability conditions on the 
smoothness indices of the underlying infinite-variate spaces are valid. These parameters are only contained in 
the order constants. This way, linear approximation theory becomes possible in the infinite-dimensional case 
and corresponding infinite-dimensional problems get manageable. 
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For the example of the approximation of the solution of an elliptic stochastic PDF it indeed turned out 
that the infinite-variate stochastic part of the problem has completely disappeared from the cost complexities 
and the convergence rates and influences only the constants. Hence, these problems are strongly polynomially 
tractable (see [47] for a definition). Note at this point that the m-variate physical part of the problem and 
the infinite-variate stochastic part are not separately treated in our analysis but are collectively approximated 
where the hyperbolic cross approximation involves a simultaneous projection onto both parts which profits from 
the mixed regularity situation and the corresponding product construction. Here, we restricted ourselves to a 
Hilbert space setting and to linear information. Furthermore, we considered an a priori, linear approximation 
approach. 

We believe that our analysis can be generalized to the Banach space situation, in particular, to the Li- and 
Loo-setting which is related to problems of interpolation, integration and collocation. Then, instead of linear 
information, standard information via point values is employed and non-intrusive techniques can be studied, 
which are widely used in practice. To this end, the efficient approximative computation of the coefficients /k,s 
still needs to be investigated and analyzed in detail. We hope that some of the ideas and techniques presented 
in the this paper will be useful there. 

For our analysis, we assumed the a priori knowledge of the smoothness indices and their monotone ordering. 
This is sound if these smoothness indices stem from an eigenvalue analysis of the covariance structure of the 
underlying problem and are explicitly known or at least computable. If this is however not the case, then, instead 
of our a priori definition of the hyperbolic crosses from the smoothness indices, we may generate suitable sets 
of active indices in an a posteriori fashion by means of dimension-adaptivity in a way which is similar to 
dimension-adaptive sparse grid methods ESI ED. 

Finally, recall that we assume linear information and an associated cost model which assigns a cost of 0(1) 
to each evaluation of a coefficient /k.s- Or, the other way around, we just count each index (k, s) in a hyperbolic 
cross as one. We may also consider more refined cost models which take into account that the number ^(k, s) 
of non-zero entries of an index (k, s) is always finite. This would allow to relate the cost of an approximation 
of the coefficient /k.s to the number of non-zero entries of each (k, s) in a hyperbolic cross induced by T. For 
examples of such refined cost models, see e.g. the discussion in m and the references cited therein. In our case, 
this would lead to a cost analysis where the cardinality of the respective hyperbolic cross is not just counted by 
adding up ones in the summation, but by instead adding up values which depend on /^(k, s) via e.g. a function 
thereof, which reflects the respective cost model. 
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Appendix. We now show for a simple model problem of the type (EH) that its solution u belongs to the 
space A“(I™)® A''’P>^(ID)°“) for any p,q > 0 provided that a certain assumption on cr and thus a certain condition 
on r is satisfied. Consequently, our theory is indeed applicable here. 

We consider the problem 


-divx (cr(x, y)Vxu(x, y)) = /(x), u\oim = 0. (6.1) 

Here, we assume that 0 < CTmin < (^(x, y) < CTmax < oo for all x S I™ and all y G ID)°“. Moreover, we follow 
closely the seminal article m and consider the linear affine setting 


cr(x,y) =a{x) + J2^ji^)yj- 


( 6 . 2 ) 
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We furthermore assume that there is0</3<a<oo and a ■.= a — (3 such thaiEI 

and {w £ : Aw e {1'^)} ^ . 

Recall our definitions (1321) and dSH) of the spaces £ and C^. Also recall our definition (12.401) of the scalar 

oo / oo \ 

p{k,s) ■= max (1 + !%!)“ Y[ (1 +£|sil)”‘^exp '^rj\sj\ =: XmA^)Pr,p,g{^) =■ AA(k,s) (6.3) 

j=i \j=i j 

together with the notations of Am,o(k) from (I3.20L p{r,p,q) from (13.261) and AA(k, s) from (14.71) . respectively. 
We encounter the non-periodic setting here and thus have only non-negative values for the indices k and s in 
the sets I, J, i.e. (k, s) S Z™ x . Now, for the orthogonal basis (/)k,s := </'i.k ® <(' 2 ,s of (13.41) for £ from (13.21) . 
we assume for reasons of simplicity some suitable orthogonal basis for and we specifically use products of 
Legendre polynomials for We set 

and 4>2 s = ® ^2 s, I c.f. (13.31) . Furthermore, we have that 

’ ^3*0 

A dt _ 

/ A,sjiy)A,sAy)-^ = ^k,s, and max (() 2 ,s^. (y) = v^2s7+l. 

J-i ^ -i<y<i 

We consider a series representation of the solution of (EH) as 

'«(x,y) = ^ ■U2,s(x)02,s(y)- 

For our simple affine case with product Legendre expansion, explicit estimates for the expansion coefficients 
M 2 ,s(x) can be found in [13], section 6, or [H, subsection 1.3.2. To be precise, we can use Corollary 6.1. of m 
to obtain 


|M2.; 




ff--l(lm) \ |S|! 

s! 


(J^ 


^ n 


'IIV', 




V3o 


=: 

s! 


(6.4) 


Next, we have 


Pr,p,I 3 r(s) ||M2,s||/^l(Jm) — (1+ P^j) exp j Tj Sj j || 112,8 ||(Jm) 


^= 1 , 83/0 

|s|! 
s! 




< B— (^{1+ psj) exp (rjSj) b] 

J —l,Sj^0 


Moreover, since (1 +psj) < 1, this yields 


Pr.p.g(s) ||M2,s||^l(im) < ^7 = 11 ^3^ 


i=i 


S|! 

s! 




=■ 


with 


V aaniin 


^Especially, we even may assume here ~ //qII"*), i.e. /9 = 1, and ~ n i.e. a = 2, and thus a = 1. 
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Now, we have 




U2. 


sll^Q(Im) 


/ SGJ ^2(J) V J S£J 


eHj) 


and we want to derive a condition for it to be finite. To this end, we have 


B^b(r) 


sGj 


< 


P(J) 


BMb(r)' 


S^J 




ijljtbW' 


sG J 


< 


l^J) 


i?^b(r)‘ 


s&J 


iHj) 


Now, we can apply Theorem 7.2. of m and get 


(BMb(r)-) 

= E 

BMb(r)- 

V /sGy 

iHJ) sej 

ol 


< oo 


{bji^ 


i6N 


= E 




^ v^o 


exp (vj) < 1. 


Furthermore, we obtain in this case 


(BHb(r)-) 

= E 

BMb(r)- 

V /sGj 

iHJ) sGj 

ol 


B 


1 - 


{bjii 


jGP 


Thus, it finally holds that 




U2'. 




sej 


< 


iHJ) 


Briber)' 


sej 


< oo 


e^j) 


is equivalent to 


In other words, we have derived that u G K°‘{¥^) (g) for any p,q > 0 provided that the condition 

(ESI) is satisfied. 

For the case p,q > 0, it remains to check the condition (12.5311 from Theorem 12.91 If we assume rj > pq and 
rj > , then we have with a = a — P that 

M„(m):=(l+p/2)«"/.f;|£f^ 

j=l ' i a P'i a 


is finite if 


y exp(-frj-) ^ 1 a 

r. — — pq— ~ ri — pq m 


j = l -J a a " -j 

Hence, with suitable constant c, we have for any bounded (t(x, y) of the form (16.211 with 




<c-exp (-(l + ^)’^i) 

that both conditions, i.e. (lOll and (16.6L are fulfilled. 


( 6 . 6 ) 
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Analogously, for the case p = 0,g > 0, it remains to check the condition (12.421) from Theorem 12.71 Then we 
have that 


Mo,q{m) ■= 


i=i 


i/o- — 1 


is finite if 


E ^mr,la _ 1 ^ 1 _ E ^ 

j=i i=i 

Hence, with suitable constant c, we have for any bounded (t(x, y) of the form (16.211 with 

< c - exp (- (l + r,) 

that both conditions, i.e. (1631) and (EH), are fulfilled. Moreover, in this case we do not encounter the factor 
1 + m/(2a) in the exponent but merely the improved factor 1 + m/a. 

Let us finally mention that, for our affine case with a product Legendre expansion and additionally using a 
(5-admissibility condition (c.f. [a, formula (2.8)), there are explicit estimates for the corresponding expansion 
coefficients in subsection 4.2, or m, subsection 1.3.2, see also [5], proposition 7. In contrast to dna), these 
bounds now have product structure. They match (13.2611 with associated values r and p = 2, g = 1/2 up to an 
r-dependent product-type prefactor. It has the form Jl^i 4’{i) = 2 (^- 1 ) looks independent 

of Sj at first sight. But, due to the condition Sj 7^ 0, it is indeed dependent on s. After some calculation, it 
can be shown that there exist a modified sequence f and modified p, q such that ()3.26ll with, for example, the 
values f = r — log(j), e > 0 and p = 2,q = 3/2 is exactly matched. It is now a straightforward calculation 
to derive ^(x, •) G due to its definition via (13.241) and (13.251) . Of course, it remains to show that 

Mp^q{m) < 00 is valid for these f, compare (I2.53|l . To this end, we obtain for ~ Pg) the 

upper bound ' (up to a constant). Thus, for example in the case m = 3, a = 1, a growth 

of r like Vj > (7/6-1- e) log(/), e > 0 is sufficient. Note that this is indeed a quite mild condition. 
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